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SECTION  I 


INTRODUCTION 

The  Navy  formally  implemented  Instructional  Systems  Development  (ISD)  in 
July  1976  with  the  establishment  of  an  Instructional  Program  Development 
Center  (IPDC)  at  San  Diego.  Since  that  date,  considerable  resources  have 
been  committed  to  the  Navy's  IPD  effort. 

There  has  been  continuing  concern  about  the  efficiency  and  effectiveness 
of  the  IPDC  network  and  a  recognized  need  for  a  long-range  plan.  Consequently, 
the  Training  Analysis  and  Evaluation  Group  (TAEG)  was  tasked  by  the  Chief  of 
Naval  Education  and  Training  (CNET)  to  investigate  the  long-range  role  of 
the  IPDC  in  the  outyears.  The  tasking  stated  that  "particular  attention 
should  be  paid  to  the  class  'C'  and  ' F *  schools  and  to  the  cost  effectiveness 
of  the  current  and  planned  IPD  center  network. Neither  the  cost  effectiveness 
of  the  ISD  process  nor  the  adequacy  of  the  IPDCs  performance  was  the  central 
issue  of  the  study. 

The  task  was  divided  into  two  phases.  Phase  I  documented  the  costs, 
output,  and  problems  of  the  IPDCs  from  their  establishment  in  1976  through 
September  1980.  Phase  II  of  the  study  addressed  issues  dealing  with  the 
improvement  and  efficiency  of  the  IPD  effort.  Data  from  both  efforts  will 
support  the  development  of  a  command-wide  plan  for  developing  and  maintaining 
instructional  material  for  all  "A,"  "C,"  and  "F"  courses. 

This  report  is  the  phase  I  study.  Detailed  analyses  emphasize  the 
economic  aspects  of  the  course  development  and  implementation  process  as  it 
occurred  between  July  1976  and  September  1980.  The  study  results  also  provide 
inputs  to  the  phase  II  effort.  The  phase  II  effort  will  be  reported  in  a 
separate  document.  Work  on  the  project  began  in  mid-1980  but  was  delayed  in 
order  that  the  analysis  could  include  all  of  the  FY  80  data.  The  FY  80  data 
was  received  in  December  1980. 

PURPOSE 

The  purpose  of  the  present  study  was  to  provide  empirically-based  factors 
which  could  be  used  to  develop  a  realistic  long-range  plan  for  the  orderly 
implementation  and  efficient  management  of  the  Navy's  IPD  effort.  Specific 
objectives  were: 

document  the  resources  expended  by  functional  areas  of  the  ISD 
model 

identify  factors,  contingencies,  and  problems  encountered  in  the 
IPD  effort  which  impact  on  efficiency 

provide  an  objective  data  base  from  which  productivity  estimates 
can  be  derived  for  planning 

^CNET  (N-53)  tasking  ltr  of  21  Feb  1980,  subj:  Tasking  for  a  study  of  the 
long  range  role  and  mission  of  Instructional  Program  Development  Centers 
(IPDC's). 
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provide  data  which  can  be  used  to  aid  in  developing  a  more  cost- 
effective  management  plan  for  future  IPD  efforts 

identify  areas  which  could  be  investigated  as  to  the  feasibility 
for  improving  efficiency  and  operation  of  the  IPOC  effort. 


BACKGROUND 

The  CNET  in  January  1975,  directed  a  study  group  to  develop  a  plan  for 
the  full  implementation  of  ISD  using  a  centralized  management  concept.  This 
study  group  developed  and  published  a  comprehensive  plan2  (subsequently 
called  the  "Blue  Book")  which  set  forth  an  approach  for  implementing  the 
ISD  procedure,  published  as  NAVEDTRA  106A. 

The  comprehensive  plan  called  for  the  ultimate  establishment  of  five 
IPDCs  to  develop  instructional  programs  for  all  NAVEDTRACOM  courses.  The  Blue 
Book  provided  a  plan  for  the  management  and  organizational  structure  of  the 
five  IPDCs  and  an  orderly  procedure  for  the  transition  of  course  curriculum 
development  and  maintenance  into  the  IPD  program  over  a  12-year  period.  The 
Blue  Book  called  for  a  two  phased  effort.  During  phase  I,  the  ISD  process 
was  to  be  applied  to  the  193  high-volume  indoctrination  and  basic  skill 
courses.  Phase  II  called  for  the  application  of  ISD  to  the  remaining  2,000 
plus  courses  representing  advanced  skill  training  and  system-specific  courses. 

This  plan  was  based  upon  a  set  of  assumptions  and  constraints  on  resource 
availability  and  productivity  rates.  These  assumptions  were  derived  from 
data  obtained  from  previous  ISD-like  efforts  in  CNET  and  from  industry 
experience.  The  funding  requirements  for  the  plan  represented  an  estimate  of 
resources  required  for  full  implementation  of  the  CNET  decision  to  utilize 
the  ISD  procedures  and  to  phase  in  all  course  development  into  the  IPD  effort. 

The  CNET  decision  to  implement  the  ISD  program  was  supported  by  three 
economic  analyses  performed  between  November  1975  and  July  1977. 5  These 
analyses  were  based  upon  a  number  of  tentative  assumptions  dealing  with  the 
rate  and  resources  required  to  develop  course  curricula  using  the  ISD  model. 

2 

Chief  of  Naval  Education  and  Training  Support  memorandum  01A:ELL  of  11  Aug  1975, 
subj:  Plan  for  the  Implementation  of  ISD  in  NAVEDTRACOM. 

3 

Economic  Analysis  of  the  Instructional  Systems  Development  Plan,  TAEG  Techni- 
cal  Memorandum  75-6,  3  November  1975.  Training  Analysis  and  Evaluation  Group, 
Orlando,  FL  32813. 


4 

Morris  G.  Middleton,  William  M.  Swope,  William  C.  Rankin,  Eric  K.  Green, 
and  William  F.  Parrish.  Cost/Benefit  Analysis  of  the  Instructional  Systems 
Development  Implementation  Plan  (FY~77  to  FY  &2JT  TAEG  Technical  Memorandum 
76-7,  November  1976.  Training  Analysis  and  Evaluation  Group,  Orlando,  FL  32813. 

5 

William  M.  Swope  and  Eric  K.  Green,  Cost/Benefit  Analysis  of  the  Instructional 
Systems  Development  Plan.  TAEG  Technical  Memorandum  77-6,  July  1977, 

Training  Analysis  and  Evaluation  Group,  Orlando,  FL  32813. 
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These  analyses  generally  demonstrated  that  the  Naval  Education  and  Training 
Command  (NAVEDTRACOM)  plan  for  implementation  of  the  IPD  effort  would  indeed 
result  in  a  reduction  of  total  training  costs,  especially  for  the  first  few 
years  when  the  high  throughput  courses  were  brought  under  development. 

A  number  of  assumptions  were  necessary  for  the  above  economic  analyses 
and  these  were  fully  documented  in  the  referenced  technical  memorandums.  Two 
of  the  most  crucial  assumptions  which  impacted  heavily  on  the  conclusions 
drawn  from  the  economic  analyses  were:  (1)  each  fully  funded  IPDC  would  be 
able  to  develop  1,000  hours  of  instructional  material  per  year  and  (2)  courses 
developed  using  the  ISD  process  would  result  in  an  average  10  to  15  percent 
reduction  in  student  training  time.  The  previous  economic  analyses  did  not 
address  the  question  of  differential  training  effectiveness  resulting  from 
the  application  of  the  highly  structured  ISD  process.  It  was  assumed  that 
training  effectiveness  would  be  at  least  equal  to  or  "better"  using  the  IPD- 
developed  materials.  Using  the  latter  assumption,  it  was  demonstrated  that 
it  would  be  economically  efficient  to  adopt  the  proposed  IPD  implementation 
plan.  This  conclusion  was  justified  entirely  on  the  basis  of  the  projected 
saving  of  student  training  time. 

Experience  to  date,  although  limited,  indicates  that  some  of  the  assumptions 
made  in  the  previous  analyses  are  not  tenable.  For  example,  the  time  required 
for  developing  course  curricula  using  the  highly  structured  ISD  process  is 
much  greater  than  anticipated.  Also,  indications  are  that  in  the  long  run 
the  application  of  the  ISD  process  may  not  lead  to  an  average  reduction  of  10 
to  15  percent  in  student  time  primarily  because  of  the  need  to  add  new  material 
to  the  revised  course  to  satisfy  validated  task  requirements.  The  economic 
feasibility  of  the  highly  structured  ISD  process  must  depend  on  demonstrating 
that  the  application  of  this  process  leads  to  "more  relevant"  or  more  effective 
training.  Whether  or  not  the  potential  benefits  which  might  be  derived  from 
more  effective  training  are  worth  the  additional  costs  is  a  management  decision. 

Curriculum  development  is  a  necessary  part  of  training.  There  is  no 
essential  agreement  on  just  how  and  where  that  development  should  be  organized 
and  completed.  The  ISD  procedures  represent  an  orderly  process  for  developing 
curriculum,  but  where  that  development  is  to  be  done  and  by  whom  are  not 
addressed  in  the  ISD  model.  The  implementation  of  the  ISD  model  can  occur  on 
a  continuum  represented  at  one  end  by  a  highly  decentralized  developmental 
effort  concentrated  at  the  school.  The  other  end  of  the  continuum  is  repre¬ 
sented  by  a  highly  structured  organization  where  resources  are  devoted 
exclusively  to  developing  curriculum  using  the  ISD  models.  Prior  to  the  IPD 
effort  the  Navy  depended  on  the  local  training  organization  to  develop  its 
own  training  program  and  curriculum.  The  products  often  were  judged  in¬ 
adequate  and  suspected  of  not  providing  the  most  cost-effective  training. 

Local  curriculum  development  costs  appeared  to  be  low;  however,  these  costs 
were  usually  confounded  with  other  training  costs  which  makes  it  difficult  to 
isolate  the  unique  curriculum  development  costs. 

In  1976,  with  the  formalization  of  the  IPD  effort  in  the  IPDCs,  the 
Navy  moved  toward  a  highly  structured  organizational  approach  to  implementing 
ISD.  To  date,  the  productivity  and  effectiveness  of  these  IPDCs  are  less 
than  anticipated.  A  part  of  these  deficiencies  may  result  from  inefficiencies 
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inherent  in  the  implementation  of  any  new  and  untried  program.  However, 
because  of  the  complexity  of  a  full-scale  curriculum  development  program, 
it  may  simply  be  more  expensive  to  develop  curriculum  than  originally  anticipated. 
In  addition,  when  curricula  are  developed  in  an  organization  devoted  entirely 
to  that  purpose  then  costs  incurred  are  fully  exposed,  identifiable,  and 
become  totally  incremental  for  that  decision. 

It  is  difficult  to  determine  how  much  more  expensive,  if  any,  a  curriculum 
developed  at  an  IPDC  is  over  a  similar  curriculum  developed  on  a  more  ad  hoc 
basis  at  the  schoolhouse.  This  difficulty  can  be  attributed  to  two  major 
factors.  First,  it  is  almost  impossible  to  establish  unambiguously  total 
curriculum  development  costs  at  the  schoolhouse  because  so  many  of  the 
resources  required  for  curriculum  development  are  jointly  used  for  other 
parts  of  the  training  program.  To  estimate  total  curriculum  development 
costs  would  require  one  to  allocate  these  joint  overhead  costs  among  the 
various  training  functions. 

Fortunately,  management  decisions  regarding  curriculum  development  costs 
do  not  require  one  to  estimate  total  costs  at  the  schoolhouse.  The  appropriate 
and  relevant  cost  information  required  by  management  is  the  incremental 
costs;  i.e.,  how  costs  will  change  if  the  curriculum  development  function  is 
added  or  removed  from  the  schoolhouse.  Therein  lies  the  second  difficulty. 

To  estimate  incremental  costs  it  is  necessary  to  determine  the  value  in 
alternative  uses  (opportunity  costs)  of  the  resources  which  are  currently 
devoted  to  curriculum  development.  The  problem  of  estimating  costs  for 
individuals  who  develop  curriculum  is  especially  difficult.  Many  of  these 
individuals  have  other  duties  and  removing  their  responsibil ity  for  curriculum 
development  often  will  not  eliminate  their  billets  because  of  these  additional 
duties.  For  example,  an  instructor  may  be  required  to  be  onboard  even  though 
he  teaches  only  50  percent  of  the  time.  If  he  is  presently  doing  curriculum 
development  then  his  time  may,  in  fact,  be  "free"  when  computing  the  economic 
development  costs.  If  the  curriculum  development  function  is  removed,  he  may 
be  forced  to  do  trivial  or  nonproductive  work  to  fully  utilize  his  time. 

APPROACH 

As  indicated  earlier,  TAEG  was  tasked  to  examine  the  question  of  which 
most  efficient  and  effective  organizational  and  management  structure 
for  'itinued  implementation  of  a  highly  structured  IPD  capability  within 
the  Navy.  A  return  to  the  pre-ISD/IPDC  status  quo  was  not  considered  an 
option.  Since  the  tasking  explicitly  stated  that  "particular  attention 
should  be  paid  to  class  ‘C  and  1 F *  schools  and  to  the  cost-effectiveness  of 
the  current  and  planned  IPD  center  network,"®  it  was  necessary  to  examine 
the  past  performance  of  the  IPDCs  in  terms  of  the  utilization  of  resources 
and  the  rate  at  which  instructional  material  was  being  developed.  This 
examination  involved  an  analysis  of  the  cost  and  manpower  data  bases  being 
maintained  by  the  IPDCs  and  other  empirical  data  collected  directly  from  the 
IPDCs. 

Visits  were  made  to  the  major  IPDCs  to  obtain  a  qualitative  summary  of 
problems  which  impact  on  the  productivity  of  each  center.  Situation  summaries, 

60P  cit.  CNET  N-5  tasking  Ur  of  21  Feb  1980. 


TAEG  Report  No.  103 


TABLE  8. 

PERCENTAGE  DISTRIBUTION  OF  ALL  IPDC  TIME  AMONG 

THE  ISD  FUNCTIONS — SAN  DIEGO  (1976  to  1980) 

; 

Function 

1976* 

1977 

1978 

1979 

1980* 

Administration 

59.5 

59.5 

55.5 

57.0 

53.0 

Analyze 

20.8 

15.5 

16.8 

11.8 

4.5 

Design 

3.5 

3.1 

3.6 

6.3 

5.3 

Develop 

5.5 

11.0 

15.4 

16.1 

26.3 

Media 

0.5 

7.2 

3.7 

4.7 

6.7 

Evaluation 

0.0 

0.7 

2.1 

1.9 

3.0 

Training 

9.9 

2.5 

2.5 

1.8 

0.9 

*Not  a  full  year 


TABLE  9.  PERCENTAGE  DISTRIBUTION  OF  IPDC  TASK  TIME  ASSIGNED 
TO  THE  ISD  FUNCTIONS  -  SAN  DIEGO  (1976  to  1980)* 
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to  tasks  supporting  that  rating.  If  for  any  pay  period  the  equivalent  number 
working  on  the  task  exceeded  nine  individuals  then  the  number  was  coded  with 
an  appropriate  symbol  as  given  in  the  legend  on  the  figure.  For  example, 
during  the  last  pay  period  shown  in  1980,  the  equivalent  of  four  individuals 
were  working  on  the  RT  rating,  three  on  the  SA  rating,  one  on  the  GT  rating, 
nine  on  the  HT  rating,  four  on  the  E0  rating,  nine  on  the  RM  rating,  and  four 
on  the  IC  rating.  The  ST  and  DP  ratings  were  coded  as  an  "A"  which  indicated 
that  the  equivalent  of  11  to  19  individuals  were  working  on  each  of  these 
ratings.  Finally,  the  last  row,  "OH"  is  the  administrative  overhead.  The 
time  attributed  to  administration  during  the  last  period  shown  was  coded  as 
"D"  which  indicated  that  there  was  the  equivalent  of  40  to  49  individuals 
assigned  full  time  to  the  administration  functions/duties.  This  figure 
illustrates  the  distribution  of  the  work  effort  over  the  period  illustrated 
and  shows  which  ratings  were  being  emphasized  in  each  pay  period  (in  terms  of 
the  IPDC's  work  effort)  over  the  entire  life  of  the  center.  During  1979  there 
were  more  tasks  underway  than  for  any  of  the  other  years  as  indicated  by  the 
number  of  tasks  to  which  manpower  was  allocated. 
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The  distribution  of  labor  among  the  IPDC  functions,  as  a  percent  of  the 
total  available  to  the  IPOC,  is  shown  in  table  8.  In  each  year  more  than  half 
of  the  available  time  was  assigned  to  functions  classified  as  administration. 
There  has  been  a  steady  decrease  in  the  percentage  (of  the  total  time  available) 
which  has  been  attributed  to  analysis  and  a  steady  increase  in  the  percentage 
attributed  to  development.  This  change  in  emphasis  can,  with  a  high  probability, 
be  attributed  to  the  phasing  of  work  under  development.  The  San  Diego  IPDC  has 
not  been  in  existence  long  enough  to  attain  a  steady  state  in  the  composition 
and  phasing  of  tasks  under  the  various  stages  of  ISD.  In  the  long  run,  the 
distribution  of  work  among  the  ISD  phases  in  the  IPDC  may  prove  to  be  cyclical 
as  new  tasks  are  phased  in  and  others  completed. 

The  major  reason  that  so  much  of  the  IPDCs  time  has  been  assigned  to 
administration  arises  from  the  large  amount  of  time  attributed  to  nonIPD  and 
nonidentified  tasks.  Most  of  the  time  attributed  to  these  latter  two  categories 
was  assigned  to  the  administrative  function.  If  the  nonIPD  functions,  leave, 
and  nonidentified  tasks  are  excluded  from  the  distribution  of  time,  then  the 
amount  of  total  administrative  time  used  in  support  of  the  assigned  tasks 
varies  from  a  high  of  21.6  percent  in  1978  to  a  low  of  15.3  percent  in  1980 
(table  9). 

The  trend  in  administration  as  a  percent  of  all  IPDC  time  is  illustrated 
in  figure  1.  The  figure  shows  the  trend  in  administration  time  used  in 
direct  support  of  the  assigned  IPD  tasks.  There  appears  to  be  a  slight 
downward  trend  in  percent  of  total  time  devoted  to  administration. 

Given  a  fixed  labor  base,  the  rate  at  which  the  IPDCs  can  develop  the 
courses  assigned  for  ISD  will  be  affected  by  the  proportion  of  time  allocated 
to  the  nonIPD  and  nonidentified  tasks,  especially  if  those  tasks  are  not  in 
support  of  the  courses  assigned  the  IPDC  for  development.  In  1976,  50  percent 
of  the  total  IPDC  time  was  assigned  to  other  nonIPD  or  nonidentified  tasks 
(table  10).  There  has  been  a  fairly  steady  decline  in  this  percentage  since 
the  establishment  of  the  IPDC  as  illustrated  in  figure  2.  In  1980  an  estimated 
34  percent  of  the  time  was  devoted  to  nonIPD  and  nonidentified  tasks. 

The  distribution  of  time  among  the  functions  for  a  selected  set  of  ratings 
is  shown  in  appendix  B  (tables  B-l  through  B-7).  The  man-hour  and  percentage 
of  the  total  time  assigned  during  each  two  week  period  over  the  life  of  the 
project  is  displayed  in  the  appendix  tables.  As  expected,  most  projects  have 
a  large  percentage  of  project  time  assigned  to  administration  during  the  first 
few  accounting  periods.  Analysis  tends  to  be  heavy  during  the  beginning 
periods  of  the  task,  but  it  also  appears  that  during  the  life  of  most  projects 
that  there  are  subsequent  periods  when  a  significant  part  of  the  effort  is 
shifted  back  to  analysis.  The  phasing  of  the  work  effort  among  the  ISD  blocks 
seems  to  have  occurred  in  a  fairly  linear  sequence  for  most  tasks  presented  in 
appendix  B. 

A  distribution  of  the  work  effort  over  the  various  ratings  assigned  to 
the  San  Diego  IPDC  is  shown  in  figure  3.  The  distribution  is  shown  by  each 
two-week  pay  period  starting  from  the  12th  pay  period  in  1976  and  ending  with 
the  20th  pay  period  in  1980.  The  vertical  columns  at  each  pay  period  indicate 
the  equivalent  number  of  employees  (or  man-periods)  working  on  tasks  associated 
with  each  of  the  ratings.  Each  man-period  represents  80  hours  of  time  assigned 


TABLE  7.  MAN-HOURS  ATTRIBUTED  TO  EACH  ISO  FUNCTION  AT  THE 
SAN  DIEGO  IPDC  (1976  to  1980) 
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Table  6  shows  a  summary  of  the  distribution  of  man-hours  reported  by  the 
IPDCs  since  their  establishment.  Seventy- two  percent  of  the  time  has  been 
attributed  to  course  development,  but  only  45  percent  of  the  total  hours  have 
been  directly  attributed  to  the  analysis,  design,  development,  and  validation 
of  instructional  materials.  Indirect  course  development  support  (made  up 
largely  of  nonidentified  tasks)  and  nonIPD  tasks  accounted  for  approximately 
48  percent  of  the  total  labor  reported  during  the  period  1976  to  1980.  In 
general,  the  man-hour  accounting  instruction  directs  that  employees  occupying 
billets  which  are  not  IPD  dedicated  but  who  work  on  IPD  tasks  will  assign 
that  portion  of  their  time  they  are  not  working  on  IPD  tasks  to  the  nonIPD 
category. 9  It  is  not  clear  whether  the  time  has  been  appropriately  assigned 
per  the  instruction.  There  was  some  indication  that  at  least  a  part  of  the 
time  assigned  to  the  nonIPD  category  was  under  the  management  control  of  the 
IPDCs. 

TABLE  6.  PERCENTAGE  DISTRIBUTION  BY  SELECTED  CATEGORIES  FOR  MAN-HOURS 
COMMITTED  TO  THE  IPDCs  (1976  to  1980) 


Percent 

Course  Development 

72 

Direct 

45 

Indirect 

27 

Course  Maintenance 

5 

NonIPD 

21 

Other 

JZ 

TOTAL 

100 

SAN  DIEGO  IPDC.  An  analysis  of  the  labor  utilization  at  the  San  Diego  IPDC 
from  July  1976  to  September  1980  is  described  next.  The  analysis  is  limited  to 
the  San  Diego  IPDC  since  it  is  the  only  site  which  has  been  in  operation  long 
enough  to  establish  any  trends.  Even  this  site  has  relatively  few  data  points 
from  which  to  estimate  trends.  Another  reason  for  limiting  the  analysis  to 
the  San  Diego  site  is  that  a  complete  set  of  data  showing  a  detailed  functional 
breakdown  of  how  labor  was  used  is  readily  available  and  in  a  format  adaptable 
for  automated  data  analysis. 

The  total  man-hours  expended  by  the  IPDC  are  shown  in  table  7.  The  man¬ 
hours  shown  for  1976  are  for  less  than  a  full  year  since  the  site  was  not 
established  until  July  of  that  year.  Similarly,  the  data  for  1980  includes 
only  the  first  9  months;  i.e.,  through  September  1980.  The  labor  used  by  the 
IPDC  has  increased  from  60,552  hours  in  1976  to  a  projected  level  of  270,000 
hours  for  1980  and  has  not  changed  significantly  in  the  last  two  years. 

9CNETSUPP0RTINST  7400.1  Code  N62  of  27  Jun  1978,  subj:  Man-hour  Accounting 
for  Instructional  Program  Development  (IPD):  policy  and  procedrues  for. 
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5  was  308  hours  per  original  course  hour.  Design  and  development  of  the 
course  materials  accounted  for  34  percent  of  the  time.  Indirect  labor  accounted 
for  37  percent  of  the  total  labor  used.  Indirect  labor  includes  training  and 
orientation  time  of  new  employees,  administrative  support,  leave  time,  and 
miscellaneous  unidentified  tasks.  Miscellaneous  unidentified  tasks  accounted 
for  24  percent  of  the  total  labor  costs  as  determined  from  the  detailed  man-hour 
accounting  data  available.  The  indirect  category  does  not  include  typing, 
audiovisual  support,  or  any  other  support  which  could  be  directly  related  to 
each  task.  The  "other"  category  includes  specific  tasking  of  a  general  nature 
including,  but  not  limited  to,  tasks  which  attempt  to  develop  improved  procedures 
for  executing  the  ISD  model. 


TABLE  5.  MAN-HOURS  REQUIRED  PER  HOUR  OF  ORIGINAL  INSTRUCTION 
FOR  SELECTED  RATINGS  DEVELOPED  AT  THE  NAVY  IPDCs* 


Rating 

Analysis 

Design/ 

Development 

Other*** 

Indirect 

Total 

RM 

19 

131 

65 

no 

325 

IC 

93 

301 

98 

252 

744 

ST 

63 

92 

42 

101 

298 

ET 

32 

54 

22 

53 

161 

HT 

24 

65 

13 

52 

154 

EM** 

31 

92 

94 

104 

321 

FA** 

8 

113 

103 

106 

330 

EO 

12 

44 

17 

38 

111 

DP 

61 

85 

28 

89 

263 

SA 

15 

275 

88 

194 

572 

AA 

27 

247 

138 

351 

763 

Average****  40 

106 

47 

115 

308 

Percent 

of  Total  13 

35 

15 

37 

100 

*  All  instructional  material  for  the  above  ratings  is  complete  or  nearing 
completion.  For  those  still  incomplete,  an  estimate  was  made  of  man-hour 
requirements.  The  EM,  SA,  and  AA  were  significantly  increased  in  length 
which  biases  upward  the  per  hour  labor  estimates. 

**  Does  not  include  labor  services  included  in  contractual  support. 

***  Other  includes  time  which  was  in  direct  support  of  the  course  but  not 
elsewhere  classified. 

****  weighted  by  hours  developed  for  each  course. 


8 

The  average  labor  requirements  for  the  same  set  of  ratings,  when  computed  using 
revised  hours,  were  slightly  lower  at  298  manhours  per  revised  course  hour. 


TABLE  4.  LABOR  COSTS  INCURRED  IN  THE  DEVELOPMENT  OF  12  SELECTED  RATINGS 


sr  *  +  oa 

■r-  rO(-(-t-£<OQ.<<LjJ 

IQ 

oc 
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and  IT).  Twelve  ratings  assigned  to  the  IPDCs  were  sufficiently  complete  to 
estimate  development  costs.  The  development  costs  per  revised  course  hour  for 
these  12  ratings  ranged  from  $1,461  for  the  E0  rating  to  $12,686  for  the 
IC  rating.  The  average  cost  per  revised  course  hour  was  $4,635.  The  average 
cost  per  original  course  hour  for  those  12  ratings  was  only  slightly  higher  at 
$4,970.  Appendix  A  provides  a  summary  of  course  characteristics  for  courses 
completed  or  nearing  completion.  Much  of  the  variation  in  development  costs 
can  be  attributed  to  the  scope  of  the  tasking  and  the  characteristics  of  the 
instructional  material  being  developed.  Therefore,  the  costs  experienced  for  any 
given  course  must  be  judiciously  interpreted  in  conjunction  with  the  tasking  and 
the  product.  If  a  new  course  is  significantly  different  in  length  from  the  old 
course,  the  development  cost  per  original  course  hour  will  be  biased  in  terms  of 
cost  per  hour  of  new  material  developed.  Although  cost  stated  in  terms  of  the 
new  course  material  would  be  preferable  for  auditing  purposes,  the  costs  in 
terms  of  the  old  course  length  are  more  useful  for  projecting  expected  develop¬ 
ment  costs.  These  average  development  costs  appear  to  be  within  an  acceptable 
range  as  determined  from  previous  experience.  Furthermore,  the  average  costs 
were  not  significantly  different  whether  stated  in  terms  of  the  old  course 
length  or  new  course  length.  However,  there  was  considerable  variability  among 
the  costs  for  the  various  ratings. 

Labor  costs  for  the  12  ratings  are  shown  in  table  4.  Labor  costs  have 
accounted  for  45  percent  of  all  noncontract  IPD  expenditures.  (See  table  A-6, 
appendix  A.)  The  most  potential  for  improvement  in  the  productivity  rates  of 
the  IPDCs  will  come  from  the  utilization  of  labor,  because  other  expenditures 
are  largely  determined  by  course  characteristics.  Since  labor  costs  account  for 
45  percent  of  all  noncontract  expenditures,  the  potential  for  improvement  in 
total  productivity  is  somewhat  constrained. 

MANPOWER  UTILIZATION 

OVERVIEW.  The  man-hours  utilized  for  revising  the  instructional  material  for 
the  ratings  which  are  substantially  complete  are  presented  in  table  5.  The  man¬ 
hour  requirements  are  based  on  the  number  of  hours  required  for  development  per 
original  course  hour. 7  it  would  conceptually  be  more  appropriate  to  state 
the  labor  utilization  rates  in  terms  of  the  hours  of  instructional  material 
developed,  but  those  rates  would  be  of  little  value  for  planning  purposes  since 
the  number  of  hours  in  the  new  course  are  not  known  until  the  course  is  developed 
Justification  for  utilizing  present  course  lengths  stems  from  the  fact  that 
present  course  lengths  are  reasonably  reliable  predictors  of  the  newly  developed 
course  lengths.  Furthermore,  it  has  often  been  dictated  by  administrative  fiat 
that  the  new  course  must  not  be  longer  than  the  original  course  and  new  material 
has  almost  always  ensured  it  will  be  nearly  as  long. 

The  labor  required  per  original  course  hour  varied  from  111  hours  for  the 
L0  rating  to  744  hours  for  the  IC  rating.  The  average  labor  requirement 
(weighted  by  hours  developed  for  each  course)  for  the  ratings  listed  in  table 

^Original  course  hours  are  determined  by  the  course  length  in  group-paced  courses 
and  by  average  completion  time  in  self-paced  courses.  The  estimates  are  based 
on  the  length  of  course  before  development. 
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TABLE  2.  RELATIONSHIP  OF  COURSES  AND  CONTACT  HOURS  TO  THE  PERCENT 
OF  TOTAL  TRAINING  DAYS  FOR  ALL  NAVEDTRACOM  COURSES* 


Cumulative 
Number  of 
Courses 

Cumulative 
Training  Days 
(1,000) 

Percent  of  Total 
Training  Days 

Cumulative 
Contact  Hrs 

Percent  o; 
Total  Hrs 

7 

820 

5 

227 

0.04 

15 

1,640 

10 

622 

0.11 

24 

2,461 

15 

1,630 

0.30 

28 

3,281 

20 

1,842 

0.34 

34 

4,101 

25 

2,613 

0.48 

48 

4,921 

30 

4,420 

0.82 

62 

5,742 

35 

6,478 

1.20 

90 

6,562 

40 

9,662 

1.79 

110 

7,382 

45 

12,846 

2.38 

129 

8,202 

50 

17,490 

3.25 

151 

9,023 

55 

21,500 

3.99 

181 

9,843 

60 

26,508 

4.92 

231 

10,663 

65 

35,001 

6.49 

310 

11,483 

70 

47,899 

8.89 

417 

12,303 

75 

63,952 

11.87 

572 

13,124 

80 

86,183 

15.99 

826 

13,944 

85" 

125,124 

23.22 

1,145 

14,764 

90 

180,101 

33.42 

1  ,663 

15,584 

95 

279,005 

51.77 

2,869 

16,405 

100 

538,932 

100.00 

*  Excludes  Basic  Military  Training 
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When  past  IPDC  performance  is  compared  to  the  task  of  applying  the  ISD 
process  to  the  539,000  contact  hours  in  the  2,900  courses  reported  in  NITRAS, 
the  impossibility  of  accomplishing  this  task  using  a  few  highly  centralized 
IPDCs  is  apparent.  Though  this  limitation  of  the  IPDCs  capacity  was  recognized 
in  the  IPDC  planning,  the  mechanics  and  resources  for  applying  ISD  to  all  Navy 
courses  are  still  not  available. 

A  summary  of  these  courses,  contact  hours,  and  training  days  as  computed 
from  NITRAS  data  is  contained  in  table  2.  The  courses  have  been  ranked  by 
throughput  and  the  data  cumulated  for  each  5  percent  increment  in  total  training 
days.  For  example,  the  first  129  courses  represent  approximately  8.2  million 
training  days  or  50  percent  of  the  total  training  days  and  approximately  17.5 
thousand  contact  hours  or  3.25  percent  of  the  total  contact  hours.  (The  distrlbu 
tion  of  training  days  and  contact  hours  for  the  "A,"  "C,"  and  "F"  courses  is 
shown  in  tables  A-2,  A-3,  and  A-4,  respectively  (See  appendix  A.)) 

Table  2  shows  that  a  relatively  large  share  of  the  total  Navy  training  is 
represented  by  a  relatively  small  share  of  the  total  contact  hours.  The  IPD 
effort  could  be  applied  to  75  percent  of  total  Navy  training  by  developing  only 
12  percent  of  the  total  contact  hours  or  63,900  course  contact  hours.  All  of 
the  courses  making  up  the  above  12  percent  will  not  need  major  revision  and  by 
carefully  selecting  the  courses  for  development  a  substantial  part  of  Naval 
training  can  be  developed  without  completely  developing  all  courses.  The  most 
return  for  resources  utilized  at  the  IPDCs  will  be  realized  if  those  courses 
scheduled  for  development  in  the  IPDCs  are  those  courses  which  have  a  relatively 
high  throughput  and  are  the  most  deficient  in  meeting  the  current  training 
objectives. 

IPD  EXPENDITURES 

From  the  establishment  of  the  IPDCs  in  1976  through  September  1980,  the 
total  IPD  expenditures  have  exceeded  $31  million  (table  3).  These  represent  the 
actual  budgeted  expenditures  and  are  considerably  less  than  the  actual  taxpayer 
costs  of  the  program.  Much  of  the  overhead  costs  are  not  included  in  these  cost 
data.  A  total  of  $7.2  million,  or  23  percent  of  the  total  IPD  resources,  was 
expended  on  software  development  (and  some  minor  equipment  purchases)  supporting 
the  EW  rating.  Approximately  $2.2  million  was  committed  for  a  software  develop¬ 
ment  contract  to  support  EW.  Much  of  the  output  of  this  software  contract  was 
of  minimal  value  because  the  contract  for  hardware  (for  which  the  software  was 
being  developed)  was  terminated.  Detailed  expenditure  and  other  summary  data 
for  each  rating  are  shown  in  table  A-5  (appendix  A). 

Nearly  $3  million  was  apparently  devoted  to  supporting  existing  school 
programs  and  was  not  used  in  direct  support  for  developing  the  instructional 
material  for  courses  assigned  to  the  IPDCs  for  development.  The  ratings 
listed  in  table  3  are  listed  by  dates  in  which  they  were  first  tasked  by  CNET. 
There  is  no  evidence  from  these  data  to  indicate  that  productivity  rates  have 
been  improving.  However,  variation  in  tasking,  contract  services,  and  the 
extent  of  the  development  effort  would  tend  to  obscure  trends  which  might 
indicate  changes  in  productivity  rates. 

The  original  7,200  course  contact  hours  scheduled  for  ISD  at  the  IPDCs  do 
not  include  those  ratings  which  have  been  heavily  contract  supported  (EW,  CT, 
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TABLE  1.  COMPLETION  STATUS  FOR  COURSES/RATINGS  UNDER 
DEVELOPMENT  AT  THE  IPDCS  AS  OF  SEPTEMBER  1980 


r 

Rating 

Percent  Complete 

Analysis 

Design 

Development 

Validation 

RM 

100 

100 

100 

100 

DS 

100 

N/A 

N/A 

N/A 

IC 

100 

95 

95 

95 

ST 

100 

0-99 

0-99 

0-99 

ET 

100 

85 

85 

85 

HT 

100 

63 

63 

63 

EM 

100 

60 

60 

0 

FA 

N/A 

100 

100 

75 

EO 

100 

95 

95 

95 

CM 

100 

0 

0 

0 

UT 

100 

46 

46 

46 

EA 

100 

0 

0 

0 

BU 

100 

0 

0 

0 

SW 

100 

0 

0 

0 

CE 

100 

0 

0 

0 

DP 

100 

87 

87 

87 

SA 

N/A 

96 

96 

96 

AA 

N/A 

100 

100 

85 

FT 

60 

10 

10 

0 

BE&E 

N/A 

90 

90 

10 

EW 

★ 

* 

★ 

★ 

CT 

★ 

* 

* 

★ 

IT 

★ 

* 

★ 

★ 

RT 

30 

N/A 

N/A 

N/A 

MM 

35 

8 

8 

0 

BT 

35 

8 

8 

0 

PE 

75 

30 

30 

0 

GM 

N/A 

5 

5 

0 

*  Contract  supported 
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SECTION  II 
ANALYSIS 


This  section  includes: 

an  analysis  of  cost  and  productivity  for  developmental  work 
completed  and  currently  underway  at  the  IPDCs 

a  summary  of  the  IPDC  expenditures  for  the  1976  to  1980  period 

an  analysis  of  the  expenditure  and  output  data  to  determine 
productivity  and  trends  in  development  cost 

an  analysis  of  the  utilization  of  manpower. 

COURSES/RATINGS  CURRENTLY  UNDER  DEVELOPMENT 

The  first  tasking  from  CNET  to  the  IPDCs  was  issued  in  May  1976.  Since 
then,  taskings  have  been  issued  to  develop  and  revise  courses  and/or  modules 
which  support  nearly  30  ratings.  The  taskings  have  varied  from  those 
requiring  complete  revision  of  an  entire  curriculum  (e.g.,  RM  rating)  to 
others  which  focused  on  the  development  of  instructional  material  for  specific 
equipments  (e.g.,  the  ST  rating). 

Table  1  lists  the  ratings  for  which  instructional  material  development 
has  been  completed  or  is  underway.  The  RM  rating  is  the  only  rating  reported 
100  percent  complete  as  of  September  1980.  Several  ratings  are  nearing 
completion,  and  the  revised  curricula  for  a  number  of  these  have  been  tested 
and  are  being  implemented.  Considerable  difficulty  has  been  encountered  with 
the  RM  and  IC  curricula  and  consequently  there  have  been  a  number  of  special 
taskings  to  correct  deficiencies.  Much  of  the  difficulty  stems  from  the  fact 
that  these  were  the  first  ratings  developed.  The  resources  required  for  these 
corrective  taskings  have  been  attributed  to  course  maintenance  and  included  in 
the  course  maintenance  data  in  the  resource  accounting.  A  number  of  ratings 
listed  in  table  1  include  recent  taskings  and  only  minimal  work  has  been 
accomplished  to  date  on  these  taskings. 

The  courses  supporting  the  28  ratings  listed  in  table  1  which  have  been 
scheduled  for  treatment  by  the  IPDCs  represent  approximately  7,200  original 
contact  hours  as  determined  from  data  in  the  Navy  Integrated  Training  Resources 
and  Administrative  System  (NITRAS).  These  courses,  when  completed,  will 
include  less  than  2  percent  of  the  total  contact  hours  and  17  percent  of 
the  total  training  days.  However,  many  of  the  courses  included  represent 
recent  taskings,  and  the  work  underway  does  not  accurately  reflect  or 
measure  the  accomplishment  over  the  first  four  years  of  the  ISD/IPDC  commit¬ 
ment.  If  only  those  ratings  are  included  in  which  the  validation  phase  is 
reported  at  least  85  percent  complete  as  of  September  1980,  then  approximately 
0.5  percent  of  all  contact  hours  have  been  revised  which  includes  less  than 
4  percent  of  the  total  training  days.  Tasking  to  date  has  almost  totally 
involved  the  "A"  courses.  Those  courses  which  are  substantially  complete 
account  for  approximately  4  percent  of  all  "A"  school  contact  hours  and 
include  approximately  12  percent  of  the  total  "A"  school  training. 
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which  were  submitted  at  least  bi-weekly  between  the  period  1976  and  1980, 
were  also  reviewed  to  isolate  those  problems  which  were  reported  and  assumed 
to  impact  on  the  operation  of  the  IPDCs. 

Each  IPD  site  reports  a  detailed  breakdown  of  labor  utilization  in  a 
CNET  developed  and  maintained  man-hour  accounting  system.  These  data  were 
collected,  summarized,  and  analyzed  to  extract  information  on  the  utilization 
of  labor. 

The  expenditures  attributed  to  the  IPD  effort  have  been  carefully  docu¬ 
mented  since  the  establishment  of  the  first  IPDC  at  San  Diego  in  July  1976. 

These  expenditures  are  documented  in  sufficient  detail  to  identify  the  resources 
expended  by  each  tasking  and/or  course.  These  detailed  cost  data  were  collected 
for  the  period  July  1976  to  September  1980  and  are  the  basis  of  the  cost 
analysis  presented  in  this  study.  The  cost  data  compiled  for  each  tasking 
and  course  were  reconciled  with  the  official  budgetary  records  to  insure  data 
integrity. 

Each  month  the  situation  summaries  for  each  IPDC  provide  an  estimate  of 
the  percent  complete  of  each  tasking.  These  estimates  were  used  to  determine 
the  equivalent  hours.  The  equivalent  hours  were  then  used  as  a  basis  for 
determining  the  cost  of  work  in  progress.  Each  IPDC  was  asked  to  complete  a 
form  explaining  the  characteristics  of  the  courses  which  have  been  developed. 

A  summary  of  the  survey  results  is  presented  in  appendix  A.  Productivity 
rates  were  computed  on  the  basis  of  equivalent  hours  completed  using  data 
obtained  from  the  above  sources. 

The  man-hour  accounting  data  and  cost  summaries  presented  in  this  report 
are  often  drawn  from  different  sources.  These  aggregate  summaries  were  used 
to  extract  information  which  would  enable  judgments  to  be  made  about  current 
productivity  rates  and  trends,  and  to  relate  the  potential  work  effort  ahead 
to  what  has  been  accomplished  over  the  first  four  years  of  the  IPDCs'  efforts. 

The  need  to  draw  data  from  various  sources  has  led  to  some  reduction  in 
precision  of  numbers  but  not  in  the  objective  of  obtaining  useful  management 
information  for  planning.  This  study  drew  extensively  from  existing  data 
bases  and  interim  status  reports  and  any  deficiencies  in  these  data  bases  and 
reports  will,  to  some  extent,  be  reflected  in  the  study  findings.  An  effort 
was  made  to  identify  these  deficiencies,  and  the  findings  were  then  appropriately 
caveated. 

ORGANIZATION  OF  THE  REPORT 

In  addition  to  this  introduction,  the  report  contains  three  sections  and 
two  appendices.  Section  II  contains  an  analysis  of  the  cost  and  utilization 
of  manpower  for  the  period  1976  to  1980.  The  analysis  focuses  on  the  two 
major  IPDCs  at  San  Diego  and  Great  Lakes  and  includes  a  detailed  descriptive 
analysis  of  manpower  utilization  trends  at  the  San  Diego  IPDC.  Section  III 
addresses  problems  dealing  with  productivity  and  output  of  the  IPDCs.  Section 
IV  contains  a  summary  of  the  report  including  resources  expended,  problems, 
and  recommendations.  Appendix  A  is  a  summary  of  cost  and  productivity  data. 
Appendix  B  includes  detailed  labor  utilization  by  ISD  functions  and  pay  periods 
for  a  selected  set  of  courses  which  have  been  developed. 
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1976  77  78  79  80 

Figure  1.  Percent  of  IPDC  Time  Assigned  to 

Administration,  1976  to  1980  (San  Diego) 


Figure  2.  Percent  of  Total  Time  Available  Which  Was 
Allocated  to  NonIPD  and  Nonidentified 
Tasks  (1976  to  1980) 
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SECTION  III 
IPDC  PRODUCTIVITY 

The  rate  at  which  the  IPDCs  develop  instructional  materials  can  be  in¬ 
creased  by  committing  more  resources  to  the  IPDC  and  improving  the  efficiency 
of  the  developmental  process. 

RESOURCES  COMMITTED  TO  THE  IPDCs 

The  Navy  must  develop  instructional  material  to  train  personnel  in  the 
use  and  maintenance  of  new  technology  and  to  update  and  improve  existing 
courses.  The  essential  question  is  whether  the  highly  structured  IPDC  is 
the  most  efficient  way  to  accomplish  the  necessary  course  development 
and/or  revision. 

Past  justification  for  the  IPDCs  has  rested  on  the  assumption  that  an 
IPDC  developed  course  would  be  of  high  quality  and  would  usually  reduce 
training  time.  It  was  assumed  that  expenditures  to  establish  and  operate 
the  IPDC  would  be  justified  by  the  cost  savings  associated  with  the  reduced 
training  time.  Therefore,  there  was  little  effort,  if  any,  devoted  to 
analyses  of  alternative  strategies  for  implementing  the  ISD  model.  However, 
as  shown  in  section  II,  the  current  rate  of  course  development  by  the  IPDCs 
will  not  be  adequate  to  develop,  update,  and  maintain  all  Navy  courses  in  a 
timely  manner. 

Since  the  rate  at  which  development  occurs  in  the  IPDCs  depends  primarily 
on  the  quantity  of  resources  devoted  to  the  ISD  effort,  it  will  require  a 
massive  investment  and  expenditure  to  apply  the  ISD  process  to  all  courses 
using  the  present  highly  structured  IPDC  organization.  Even  if  the  average 
development  time  at  the  IPDCs  could  be  reduced  to  100  man-hours  per  hour  of 
instruction  (a  100  percent  improvement)  with  over  500,000  hours  of  instruction 
in  all  NAVEDTRACOM  courses,  it  would  require  a  minimum  of  six  to  seven 
thousand  man-years  to  develop  all  courses.  The  labor  required  for  course 
maintenance  would  add  significantly  to  manning  required. 

The  benefits  of  past  IPD  efforts,  in  terms  of  quality  and  relevancy  of 
instruction  and  reduction  of  training  time,  may  well  exceed  the  costs  even 
though  it  will  require  a  large  commitment  of  resources  to  completely  ISD 
all  Navy  courses.  For  example,  although  most  IPDC  personnel  would  prefer 
to  eliminate  the  IC  rating  (because  of  the  high  development  costs)  from  any 
analysis  which  attempts  to  determine  the  returns  to  the  ISD  process,  the 
data  indicate  that  the  IC  course  will  be  reduced  by  more  than  20  percent  in 
length.  Assuming  no  degradation  in  student  performance  from  using  the  new 
course,  the  reduction  in  course  length  will  yield  substantial  benefits  in 
terms  of  resources  saved  making  it  a  highly  attractive  investment.  The 
reduction  in  student  costs  would  pay  for  the  development  costs  in  four  to 
five  years. 

Even  so,  a  favorable  benefit/cost  ratio  does  not  justify  the  present 
structure  of  the  IPDCs  if  the  benefits  per  dollar  of  expenditure  may  be 
further  increased  by  alternative  means.  For  example,  restructuring  the 
IPDCs  in  a  way  which  more  fully  integrates  the  local  school  resources  into 
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the  development  process  may  reduce  development  costs.  In  addition,  benefits 
could  be  improved  by  limiting  the  IPDC  efforts  to  those  courses  which  have  high 
throughput  and  to  those  courses  or  parts  of  courses  which  are  determined  to  be 
deficient  in  effectiveness  and/or  efficiency. 

Resources  committed  to  the  ISO  effort  at  the  IPDC  can  yield  significant 
returns,  but  the  amount  which  should  be  allocated  to  ISD  depends  upon  the 
alternative  returns  from  other  competing  resource  demands.  Analyses  to  support 
those  allocation  decisions  are  beyond  the  scope  of  this  effort.  However,  once 
the  decision  is  made  to  allocate  a  specified  level  of  funding  to  the  IPD  effort 
then  an  appropriate  management  objective  is  to  utilize  those  funds  to  maximize 
the  benefits  to  the  training  command.  This  report  is  intended  to  support  the 
latter  management  objective. 

MEASURING  EFFICIENCY  IN  THE  DEVELOPMENT  OF  COURSES 

Efficiency  in  production  is  measured  as  the  rate  of  output  per  unit  of 
resources  employed.  Identification,  measurement,  and  the  tracking  of  resources 
utilized  have  been  relatively  complete  and  accurate  for  the  Navy  IPD  effort. 
However,  the  identification  and  measurement  of  the  IPDCs'  output  is  at  best 
a  highly  subjective  undertaking.  One  measure  of  efficiency  in  production 
frequently  employed  is  the  resources  used  per  original  course  hour  revised 
and/or  developed.  Much  of  the  criticism  of  this  measure  centers  on  the  fact 
that  the  scope  of  the  effort  among  the  various  tasks  was  quite  different. 
Consequently,  variation  in  resources  utilized  (per  original  course  hour)  among 
the  various  courses  would  arise  from  factors  other  than  variation  in  efficiency. 
However,  the  present  course  length  (or  average  contact  hours),  an  indirect 
measure,  is  the  only  readily  available  measure  for  estimating  the  magnitude 
of  work  required  for  any  course  scheduled  for  ISD.  Productivity  rates  derived 
from  these  measures  provide  useful  data  for  management  and  planning. 

The  cost  and  man-hour  requirements  per  original  contact  hour  were  computed 
for  courses  presently  under  development  at  the  IPDC.  Because  of  the  variation 
in  tasking,  course  characteristics,  quality  of  existing  course  material,  and  a 
number  of  other  factors,  the  productivity  rates  experienced  in  the  development 
of  each  course  must  be  heavily  caveated  in  their  interpretation.  A  particular 
productivity  rate  only  offers  evidence  of  the  general  magnitude  of  effort  which 
will  be  required  for  future  ISD/ IPD  work,  and  the  resources  used  for  the  develop¬ 
ment  of  any  given  rating  should  not  be  the  sole  basis  for  making  judgments  about 
the  efficiency  of  IPDCs  in  developing  that  rating. 

The  development  cost  per  original  contact  hour  which  has  been  computed  for 
the  IPDCs  efforts  to  date  may,  in  some  instances,  tend  to  understate  the  costs 
which  would  have  been  experienced  with  a  full  developmental  effort.  This 
potential  underestimate  would  result  from  two  considerations.  First,  the  costs 
are  averaged  over  all  of  the  original  contact  hours  and  if  a  significant  amount 
of  material  from  the  existing  course  was  adequate  or  needed  only  minimal  develop¬ 
ment  it  would  tend  to  reduce  the  average  cost  per  original  hour.  Second,  If 
the  IPDC  only  addressed  certain  phases  of  the  ISD  model  then  average  cost  per 
original  contact  hour  would  be  underestimated. 

The  man-hour  and  cost  accounting  data  provide  a  record  of  the  utilization 
of  resources  committed  to  the  IPD  effort  since  the  establishment  of  the  IPDCs. 
However,  no  clear  and  standardized  means  for  identifying  the  nature  and  scope  of 
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the  tasking  of  the  IPDCs  by  CNET  exists.  Tasking  letters  from  CNET  to  the  IPDCs 
vary  from  very  cryptic,  generalized  statements  to  more  specific  statements 
detailing  the  nature  of  the  work  to  be  accomplished.  The  establishment  of  a 
preanalysis  baseline  data  report  at  the  initiation  of  each  task  would  provide 
the  basis  for  ascertaining  the  nature  and  scope  of  the  development  effort.  The 
resources  required,  present  length  of  course,  throughput,  student  performance 
scores,  average  on  board  and  a  number  of  other  data  items  could  be  included  in 
this  baseline  report.  At  the  present  time  many  of  these  data  are  not  readily 
available  and  it  is  difficult  to  reconstruct  the  data  to  use  as  a  basis  for 
evaluating  the  present  IPD  effort. 

When  a  tasking  is  completed,  a  postdevelopment  report  could  be  prepared 
which  would  include  data  on  the  new  course.  Many  of  the  data  items  would  be 
identical  to  the  preanalysis  report.  Using  these  data  items,  one  could  deter¬ 
mine  how  the  course  was  changed  and  what  resources  were  committed  to  effect 
those  changes.  One  significant  difficulty  with  the  present  reporting  system  is 
that  there  seems  to  be  no  point  in  the  development  process  where  a  course  can 
be  identified  as  completed.  Each  course  developed  seems  to  have  transitioned 
into  a  maintenance  mode  with  no  clear  demarcation  between  development  and 
maintenance.  Consequently,  data  on  the  length  of  the  new  course,  instructional 
methods  utilized,  and  other  course  characteristics  remain  ambiguous.  The 
values  placed  on  each  data  element  depend  to  a  large  extent  on  when  the  data 
are  collected.  This  ambiguity  compounds  the  problem  of  attempting  to  determine 
if  the  ISD  process  resulted  in  a  product  worth  the  expenditure.  A  CNET  instruc¬ 
tion  establishing  a  pre  and  postdevelopment  report  could  eliminate  a  great  deal 
of  the  problems  encountered  in  analyzing  the  benefits  and  costs  resulting  from 
the  application  of  the  ISD  process. 

The  major  deficiency  in  attempting  to  evaluate  the  efficiency  of  the 
entire  ISD/IPD  effort  stems  from  the  lack  of  any  baseline  data  from  which  one 
can  determine  whether  students  trained  using  the  new  course  are  able  to  perform 
at  a  higher  proficiency  level  and  receive  more  relevant  training  than  those 
trained  using  the  old  course.  Tests  are  developed  in  the  early  stages  of  the 
ISD  process  which  reflect  current  training  needs  and  requirements.  These  tests 
could  be  administered  to  a  sample  of  students  trained  using  the  old  curriculum 
and  then  later  to  a  sample  of  students  using  the  new  curriculum.  Differences 
could  be  attributed  to  the  change  in  curriculum  resulting  from  the  IPD  effort. 

Students  trained  using  the  old  curriculum  may  not  perform  well  when 
measured  against  a  new  and  updated  set  of  training  objectives.  For  this  reason 
this  approach  has  been  criticized  as  an  unfair  basis  for  making  a  judgment  as 
to  the  adequacy  of  training  received  in  the  existing  schools.  Such  criticism 
is  based  on  the  unwarranted  assumption  that  it  is  only  the  present  schools 
performance  which  is  being  judged.  The  appropriate  objective  is  to  determine 
if  the  students  being  trained  using  the  present  curriculum  are  able  to  perform 
according  to  present  needs.  If  the  students  are  performing  according  to  present 
needs  then  the  curriculum  should  not  be  targeted  as  a  high  priority  course  for 
continued  instructional  systems  development.  If  they  are  not  performing,  then 
for  whatever  reason,  the  curriculum  and/or  school  management  needs  to  be  revised 
and  updated.  Performance  measures  obtained  from  such  testing  would  provide  a 
quantitative  and  objective  basis  for  judging  the  effectiveness  of  any  subsequent 
development. 
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These  performance  data  could  then  be  used  for  making  judgments  as  to  the 
relative  effectiveness  of  the  newly  developed  course  and  for  making  inferences 
about  the  desirability  of  the  current  ISD/IPDC  approach  to  curriculum  develop¬ 
ment.  Effectiveness  of  the  course  is  defined  here  to  mean  the  degree  to  which 
the  students  trained  using  the  new  course  are  able  to  perform  as  measured 
against  a  current  and  updated  set  of  training  objectives.  Since  the  resources 
will  have  already  been  committed  to  the  development,  any  possible  deterioration 
or  improvement  in  performance  using  the  new  course  would  serve  only  for  guiding 
and  planning  future  development.  Such  performance  data  are  necessary  for 
making  long-run  decisions  about  the  economic  feasibility  of  the  entire  ISD/IPDC 
approach  to  curriculum  development. 

PRODUCTIVITY  ENHANCEMENT 

The  large  number  of  courses  which  require  revision,  the  resource  constraints, 
and  the  rate  of  development  which  the  Navy  has  experienced  with  the  present  IPDCs 
make  it  apparent  that  some  modification  in  the  way  the  ISD  model  has  been 
implanented  is  necessary,  if  most  of  those  courses  needing  attention  are  to  be 
treated  in  a  reasonable  length  of  time.  A  move  away  from  a  philosophical 
approach  of  doing  development  "for  the  schools"  to  one  in  which  development  is 
done  "with  the  schools"  would  substantially  resolve  many  problems  presently 
encountered.  When  the  course  development  function  was  removed  from  the  school 
and  placed  in  the  IPDCs,  the  opportunity  for  utilizing  any  schoolhouse  resources 
for  course  development  was  greatly  diminished. 

An  IPD/ISD  program  which  is  highly  integrated  with  the  school  would  help 
to  minimize  the  political  difficulties  encountered  when  it  becomes  necessary  to 
update  and  develop  a  course.  In  addition,  resources  could  be  used  more 
efficiently  if  considerably  more  effort  were  devoted  to  a  preanalysis  of  the 
existing  course.  Such  an  analysis  would  make  explicit  any  unique  problems 
associated  with  the  course/school.  It  would  also  aid  in  isolating  those  parts 
of  the  course  which  were  in  need  of  development  and  revision  as  well  as  isolating 
those  parts  which  were  adequate. 

The  greatest  benefits  from  resources  applied  to  ISD  can  be  realized  if 
those  resources  are  applied  to  courses  and  modules  of  courses  which  have  the 
highest  throughput  and  which  are  in  the  worst  condition  as  determined  from 
deficiencies  in  student  performance.  Those  courses  for  which  student  performance 
is  adequate  should  not  be  high  on  the  priority  list  for  ISD  even  though  the 
course  material  may  not  meet  all  criteria  of  the  ISD  model. 

There  was  an  underlying  perception  among  personnel  in  the  centers  that  the 
ISD  procedures  may  be  too  restrictive  and  the  IPDCs  need  more  latitude  to  alter 

the  procedures  to  fit  the  task.  Although  difficult  to  identify  explicit 

incidents,  there  seems  to  be  a  predominant  orientation  toward  the  process 
rather  than  the  product.  The  "block  phenomena"  permeates  almost  every  discussion 
about  ISD.  This  "block"  orientation  aids  in  understanding  the  ISD  process  but 
appears  to  be  detrimental  and  restrictive  in  applying  and  implementing  the 

process.  The  objective  of  the  IPD  effort  should  be  to  produce  quality  instruc¬ 

tional  material  and  not  just  to  follow  the  ISD  model  for  its  own  sake.  Application 
of  the  ISD  model  should  be  viewed  as  a  means  to  an  end  and  not  as  an  end  in 
itself.  In  the  final  analysis,  the  development  of  quality  curricula  is  as  much 
an  art  as  a  science  and  the  ability  to  recognize  and  take  acceptable  shortcuts 
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in  the  application  of  the  ISD  process  should  come  with  experience.  However, 
with  the  rapid  turnover  of  personnel,  the  potential  for  gaining  that  corporate 
experience  is  severely  constrained. 

The  purpose  and  use  of  the  ISD  model  seems  to  have  been  placed  in  perspective 
for  Army  schools  by  a  recent  communication  issued  by  the  Army  Training  and 
Doctrine  Command  (TRADOC).  This  message  states  that  the  interservice  procedure 
for  Instructional  Systems  Development  "...  is  to  be  used  as  a  guide  only.  It 
is  not  a  regulation.  Its  purpose  is  to  provide  to  the  service  schools  a 
general  model,  one  of  a  number  of  such  models,  which  describe  a  set  of  procedures 
for  the  systematic  development,  implementation,  and  evaluation  of  training  and 
training  products. "1° 

If  the  primary  function  of  the  IPDC  is  to  develop  instructional  material 
using  the  ISD  process,  and  if  the  performance  of  the  center  is  to  be  measured  in 
terms  of  the  rate  at  which  instructional  material  is  developed  and/or  revised 
and  the  quality  of  that  material,  then  the  percentage  of  time  devoted  to  nonIPD 
and  nonidentified  tasks  must  be  reduced.  The  administrative  time  devoted  to 
direct  support  of  the  courses  does  not  seem  unreasonable  (approximately  20 
percent),  but  the  time  assigned  to  the  nonIPD  and  nonidentified  tasks  is 
significantly  reducing  the  time  available  for  developing  instructional  material. 


10TRAD0C  msg  101000Z  Oct  80,  subj :  Instructional  Systems  Development  (ISD) 
Procedures. 
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SECTION  IV 
SUMMARY  OF  FINDINGS 


The  IPOCs  were  established  in  1976  and  since  their  establishment  $31 
million,  identified  as  IPD  funds,  has  been  expended.  A  total  of  $7.2  million, 
or  23  percent  of  total  expenditures,  has  been  in  support  of  the  EW  rating. 

(This  study  does  not  include  a  detailed  analysis  of  the  ISD  effort  associated 
with  EW  courses  since  the  organization  of  the  EW  effort  is  atypical  of  the  way 
the  IPDCs  have  operated  during  the  first  four  years.) 

During  the  period  1976  through  September  1980,  the  development  for  one 
rating  has  been  reported  to  be  100  percent  complete.  However,  the  instruc¬ 
tional  material  for  at  least  12  courses  and/or  ratings  is  essentially  complete 
and  has  been  either  placed  in  the  school  or  is  in  the  process  of  being  validated 
and  is  nearly  ready  for  implementation. 

Excluding  those  courses  which  are  being  developed  under  contract,  the 
IPDCs,  as  of  September  1980,  have  scheduled  approximately  8,000  original 
contact  hours  for  development.  Most  of  this  development  was  type  "A"  courses. 

The  8,000  hours  represent  less  than  2  percent  of  the  total  contact  hours  which 
presently  exist  in  the  CNET  controlled  courses  and  approximately  10  percent  of 
the  total  of  type  "A"  courses.  Because  a  number  of  the  ratings  developed 
included  high  throughput  courses,  the  proportion  of  the  total  Navy  training 
which  will  use  this  new  material  is  considerably  higher  than  the  above  per¬ 
centages  would  imply.  Including  work  in  progress  (for  those  ratings  which 
were  sufficiently  complete  to  make  estimates),  it  was  estimated  that  3,200 
equivalent  hours  of  original  course  material  has  been  revised  and/or  developed. 
These  nearly  completed  courses  represent  approximatley  0.5  percent  of  all 
contact  hours  and  approximately  4  percent  of  type  "A"  contact  hours. 

Generally,  these  were  high  throughput  courses  and  ones  in  need  of  attention. 

The  benefits  are  somewhat  greater  than  the  latter  percentages  would  imply. 

During  this  period,  $21  million  (excluding  contracted  courses)  was  expended 
in  support  of  the  IPDCs  of  which  an  estimated  $3  million  was  devoted  to  support¬ 
ing  existing  school  programs  and  not  used  in  direct  support  for  developing  the 
instructional  material  for  courses/ratings  assigned  to  the  IPDCs.  The  average 
cost  of  revising  the  original  material  for  the  efforts  which  were  completed  or 
nearing  completion  was  $4,970  per  original  hour.  The  average  man-hour  require¬ 
ment  to  date  has  been  308  man-hours  per  original  course  hour  (varying  from  a  low 
of  111  to  a  high  of  744).  The  IPDCs  did  not  do  all  phases  of  the  ISD  process 
for  all  courses  assigned  for  development.  Consequently,  the  man-hours  may  tend 
to  be  slightly  understated  when  interpreted  in  terms  of  labor  requirements  for  a 
full  ISD  effort.  The  distribution  of  labor  among  the  phases  of  the  ISD  process 
for  the  ratings  nearing  completion  was  as  follows:  analysis,  13  percent;  design 
and  development,  35  percent;  other,  15  percent;  and  indirect  support,  37  percent. 
The  other  category  includes  administrative  overhead  support  which  could  be 
directly  attributed  to  the  course  under  development. 

Excluding  the  RM  and  IC  ratings,  since  they  were  the  first  ratings  developed, 
there  is  no  evidence  to  indicate  that  the  rate  of  productivity  has  shown  any 
consistent  improvement.  The  resources  utilized  per  hour  of  material  developed/ 
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revised  does  not  appear  to  be  decreasing;  on  that  basis  alone  one  might  infer 
that  there  has  been  no  improvement  in  productivity.  However,  the  quality  of 
the  instructional  material  and,  ultimately,  student  performance  is  as  important 
to  productivity  measurement  as  the  rate  of  resource  utilization.  The  paucity 
of  data  reflecting  changes  in  instructional  material  quality  and  student  per¬ 
formance  resulting  from  the  ISO  process  makes  judgments  about  productivity 
highly  tenuous.  Sufficient  data  are  not  available  to  reach  any  definite 
conclusions  about  the  changes  in  productivity,  aside  from  the  fact  that  a 
great  deal  of  disagreement  exists  on  just  how  one  should  measure  the  productiv¬ 
ity  of  the  centers. 

The  one  metric  available  to  place  in  perspective  the  potential  magnitude 
of  developmental  work  to  be  done  is  the  number  of  existing  contact  hours 
presently  under  the  cognizance  of  NAVEDTRACOM.  Using  original  contact  hours 
as  a  basis  of  judgment,  and  considering  (1)  the  rate  at  which  development  is 
being  accomplished,  (2)  the  cost  of  developing,  and  (3)  the  amount  accomplished 
to  date,  one  must  conclude  that  the  present  highly  structured  IPDCs  simply  do 
not  provide  a  realistic  capability  for  developing  and  maintaining  all  "A," 

"C,"  and  "F"  CNET-controlled  courses. 

One  basis  on  which  the  highly  structured  ISD/IPDC  program  was  justified 
was  that  it  would  reduce  the  training  time  in  the  courses  while  at  least  main¬ 
taining  the  same  level  of  training  effectiveness.  Since  so  few  courses  have 
been  completely  developed,  it  is  difficult  to  determine  if  the  average 
projected  reduction  in  course  length  of  10  to  15  percent  is  going  to  be 
realized  in  the  long  run.  An  estimate  of  the  final  course  lengths  for  courses 
presently  under  revision  would  indicate  that  the  reduction  in  hours  will  be 
approximately  10  percent.  However,  these  estimates  are  so  tenuous  and  experi¬ 
ence  so  limited  that  no  reliable  conclusions  can  be  made  from  the  experience 
with  the  courses  presently  being  developed  at  the  IPDCs. 

The  assumption  that  training  effectiveness  will  at  least  be  maintained 
can  be  neither  objectively  supported  nor  rejected.  There  simply  is  no  objective 
data  base  being  developed  and  maintained  from  which  to  make  decisions  about 
the  relative  effectiveness  of  the  newly  developed  course  versus  the  old 
course.  There  is  an  implicit  assumption  that  any  course  which  has  been 
developed  using  the  ISD  process  will  result  in  more  effective  and  relevant 
training.  However,  except  for  a  few  isolated  efforts,  there  is  no  widespread 
effort  to  pre  and  posttest  the  students'  performance  using  current  and  updated 
training  objectives  to  establish  the  validity  of  this  assumption. 

There  is  some  potential  for  improving  the  rate  at  which  curriculum  can  be 
developed  by  more  rigid  controls  on  the  utilization  of  manpower  at  the  IPDCs. 

This  would  essentially  require  the  IPDCs  to  commit  their  manpower  only  to  the 
IPD  assigned  tasks.  Such  constraints  on  assignment  would  address  the  problem 
of  utilization  but  not  the  problem  of  efficiency.  It  is  unclear  as  to  the 
nature  of  the  unidentified  and  nonIPD  tasks.  To  the  extent  that  such  tasks  do 
in  fact  play  a  vital  support  role  to  the  IPDC,  then  the  potential  for  improvement 
in  the  rate  of  production  would  be  diminished. 

PROBLEM  AREAS 

Monthly  situation  summaries  have  been  submitted  to  CNET  by  each  of  the 
IPDCs  since  the  centers  were  established.  These  summaries  document  problem 
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areas  encountered  by  the  centers.  The  problems  presented  in  the  situation 
summaries  are  summarized  in  table  11.  By  far,  the  most  difficult  problem 
encountered  since  the  establishment  of  the  IPDCs  has  been  the  availability  of 
subject-matter  expert  ( SME )  support  although  there  has  been  a  significant 
decline  in  the  number  of  incidents  reported.  There  was,  however,  indications 
from  interviews  with  IPDC  personnel  that  SME  availability  continues  to  be  a 
severe  problem  and  the  decline  in  incidents  reported  stems  from  the  fact  that 
the  reporting  of  the  SME  difficulties  did  not  stimulate  any  relief  from  the 
problem.  The  futility  of  reporting  led  to  a  reduction  in  the  number  of 
incidents  reported.  Most  problems  have  shown  a  significant  decline  in  in¬ 
cidents  reported  since  1977,  except  personnel  acquisition  and  retention.  The 
acquisition  and  retention  of  skilled  personnel  have  been  rather  severe  problems 
since  the  establishment  of  the  IPDCs.  The  largest  IPDC,  San  Diego,  has 
experienced  a  great  deal  of  personnel  turnover  at  the  midmanagement  level.  A 
review  of  personnel  actions,  as  reported  in  the  situation  summaries,  indicated 
that  70  individuals  were  hired  at  the  GS-9  to  GS-13  level  during  July  1976  to 
September  1980.  During  that  period  there  were  51  resignations  in  that  same 
group.  The  average  tenure  for  those  resigning  (as  computed  using  those 
individuals  for  which  a  hiring  and  resignation  date  were  available)  was 
approximately  20  months.  The  total  civilian  strength  during  this  period 
(including  all  GS  grades)  varied  within  an  approximate  range  of  85  to  95 
individuals.  Many  individuals  who  left  the  organization  were  highly  skilled 
technologists,  and  turnover  of  those  personnel  adversely  affected  the  produc¬ 
tivity  of  the  center.  The  high  turnover  was  attributed  in  a  large  measure 
to  (1)  the  fact  that  higher  paying  jobs  were  available  to  those  individuals 
once  they  became  experienced  in  the  ISO  process  and  (2)  the  high  cost  of 
living  in  the  San  Diego  area. 

The  following  represents  a  synthesis  of  the  problem  areas  identified 
during  interviews  with  personnel  ranging  from  the  commanding  officer  to 
working  personnel  at  the  IPDCs. 

There  was  a  great  deal  of  criticism  of  the  lack  of  well  defined 
interfaces  among  CNET,  CNTECHTRA,  the  schools,  and  the  IPDCs. 

The  role  of  the  CNET  IPD  management  does  not  appear  to  be  clearly 
perceived  at  the  IPDCs.  Difficulties  which  occur  between  the  IPDCs 
and  schools  when  the  ISD  process  is  undertaken  are  often  perceived 
as  a  result  of  insufficient  ground  work  at  the  higher  command. 

Interfaces  which  develop  among  the  participants  in  the  ISD  process 
are  too  often  of  an  adversary  relationship.  This  tends  to  reduce 
significantly  the  efficiency  and  effectiveness  of  the  IPDC  team  in 
its  major  function  as  a  curriculum  developer.  More  explicit  policy 
defining  the  interfaces,  responsibility,  and  accountability,  and 
strict  enforcement  of  that  policy,  would  tend  to  reduce  the  ambiguity 
facing  the  IPDCs. 

The  IPDCs  personnel  have  expressed  considerable  concern  about  the 
number  and  frequency  of  nonIPD  related  tasks  and  peripheral  duties 
assigned  to  the  centers.  This  concern  is  substantiated  by  the 
inordinate  amount  of  time  allocated  to  nonIPD  and  overhead  functions 
in  the  manpower  accounting  data. 
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TABLE  11. 

NUMBER  OF  INCIDENTS  REPORTED  FOR 
PROBLEM  AREAS  (1977  to  1980) 

SELECTED 

Problem 

Area 

1977 

1978 

1979 

1980* 

Inadequate  SME  Support 

24 

51 

11 

2 

Acquisition  of  Course 

|  Equipment 

8 

11 

6 

Val  idation 

10 

11 

7 

6 

Command  Communication 

Problems 

20 

13 

8 

4 

J  Personnel 

Acquisition,  Retention 

6 

13 

3 

13 

Task  Modifications  and 
Revisions 

7 

5 

2 

0 

IPDC  Support: 

Facilities  &  Equipment 

4 

6 

1 

0 

TOTAL 

71 

107 

43 

31 

*  For  9  months 
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The  future  productivity  of  the  IPDCs  will  be  diminished  significantly 
if  course  maintenance  is  retained  as  an  IPDC  responsibility. 

An  insufficient  number  of  courses  have  been  completed  to  make  any 
quantitative  judgments  about  the  future  requirements  for  maintenance. 
Estimates  indicate  that  maintenance  may  take,  on  a  permanent  annual 
basis,  15  to  20  percent  of  the  total  resources  used  in  the  development 
of  a  course.  Thus,  it  becomes  readily  apparent  that  future  produc¬ 
tivity  of  the  IPDCs  will  quickly  decline  as  they  become  encumbered 
with  maintenance  tasks;  their  ability  to  undertake  new  development 
will  be  severely  limited  and  ultimately  virtually  eliminated. 

The  compatibil ity  of  the  POM  and  budget  cycle  with  the  requirements 
of  the  IPDCs  was  severely  criticized.  The  POM  cycle  forces  the 
requirements  for  training  equipment  and  aids  to  be  identified  and 
funding  requests  to  be  submitted  long  before  the  developers  have 
established  the  type  of  equipment  needed.  This  tends  to  bias  the 
criteria  for  selection  of  instructional  methods.  It  also  sets 
unnecessary  and  unwarranted  constraints  on  the  options  available  to 
the  curriculum  developer  and  and  has  contributed  to  untimely  deliveries 
of  training  equipment.  A  more  appropriate  means  for  maintaining  the 
necessary  flexibility  in  the  selection  of  instructional  methods  by 
the  developer  would  be  to  provide  program  or  block  funding  to  the 
IPDCs  for  acquisition  of  training  aids  and  equipment.  Such  funding 
would  provide  managers  and  developers  the  flexibility  to  direct 
resources  to  those  courses  where  the  need  is  determined  as  the 
design  and  development  of  the  course(s)  unfolds. 

The  IPDC  personnel  were  concerned  with  the  ability  of  the  military 
personnel  assigned  to  the  center  to  contribute  to  the  ISD  process. 

Much  of  this  concern  arose  from  the  fact  that  the  military  personnel 
selected  for  assignment  to  the  IPDCs  were  often  relatively  inexperi¬ 
enced  in  their  ratings  and  often  below  the  rank  authorized. 

The  perceived  inability  of  the  military  personnel  to  contribute 
significantly  to  the  ISD  process  could  be  attributed,  in  part,  to 
their  lack  of  experience  and  also  in  part  to  the  lack  of  an  effective 
ISD  training  program  for  newly  assigned  military  personnel.  There 
was  also  some  indication  that  a  few  military  SMEs  were  frequently 
detailed  to  the  IPDCs  during  periods  when  they  would  have  normally 
been  off  duty.  Such  personnel  management  does  not  contribute  to 
a  highly  motivated  individual. 

The  military  personnel  are  intended  to  contribute  most  to  the 
analysis  phase,  especially  the  task  analysis  effort  which  provides 
the  basis  for  the  training  objectives.  If  the  analysis  effort  is 
reduced  at  the  IPDCs,  as  initiatives  currently  underway  would  indicate, 
then  the  need  for  military  personnel  assigned  to  the  IPDCs,  would  be 
further  reduced  unless  utilization  patterns  in  those  personnel  are 
changed.  Evidence  indicates  that  there  is  a  change  underway  in  how 
the  military  are  being  utilized.  For  example,  at  the  San  Diego  site 
approximately  one-third  of  the  military  time  is  now  assigned  to 
development  functions,  and  this  has  shown  a  steady  increase  since 
1976.  In  1980  less  than  10  percent  of  the  military  time  was  assigned 
to  analysis.  (See  table  B-8,  appendix  B.) 
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RECOMMENDATIONS 

Actions  which  should  be  considered  for  improving  productivity  rates  and 
management  of  the  centers  are  outlined  below. 

Policies  and  programs  should  be  developed  which  will  insure  the 
maintenance  of  a  more  stable  work  force  at  the  IPDCs. 

A  more  thorough  preanalysis  of  existing  course  material  should  be 
done  for  each  course  selected  for  development  with  the  objective  of 
selecting  and  targeting  for  development  only  those  parts  of  the 
course  which  are  deficient. 

Policy  statements  should  be  developed  which  make  explicit  the 
approval  requirements,  school  interfaces,  and  division  of  respon¬ 
sibilities  between  the  IPDCs  and  CNET  management. 

Procedures  should  be  developed  for  determining  and  measuring  the 
changes  in  training  relevance  and  effectiveness  which  any  ISD  effort 
has  effected.  A  pre  and  postlSD  testing  of  students,  using  a  test 
reflecting  current  training  objectives,  would  aid  in  isolating  those 
parts  or  modules  of  courses  which  are  deficient.  Equally  important, 
the  results  would  provide  an  objective  basis  for  assessing,  for 
planning  purposes,  whether  student  performance  was  sufficiently 
improved  to  warrant  the  IPD  expenditure. 

Improvements  should  be  made  in  the  current  resource  tracking  system 
with  the  objective  of  simplifying  and  providing  more  relevant 
management  information. 

A  standardized  CNET  course/curriculum  status  report  should  be 
submitted  prior  to  the  start  of  an  ISD  task  and  a  similar  final 
report  should  be  submitted  at  the  conclusion  of  each  tasking.  These 
reports  would  document  the  resources  expended,  curriculum  materials 
developed,  pre  and  posttest  results,  course  characteristics,  results 
of  the  pilot  testing  and  other  relevant  data. 

An  organizational  structure  should  be  developed  which  is  sufficiently 
flexible  to  provide  technical  support  to  any  ISD  team  made  up  of 
IPDC  personnel,  school  personnel  or  any  combination  of  both.  The 
structure  of  the  team  would  depend  on  resources  available  at  both 
the  IPDC  and  school,  potential  payoff  from  the  course  development, 
and  criticality  of  the  course. 

Block  or  program  funding  should  be  provided  for  the  acquisition  of 
training  equipment  and  materials  required  to  support  the  courses 
developed/revised  at  the  IPDCs. 


PERIOD  (1976  to  1980]  FOR  THE  DEVELOPMENT  OF  THE  IC  RATING  (continued] 
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TABLE  A-6.  INSTRUCTIONAL  SYSTEMS  DEVELOPMENT  EXPENDITURES 
BY  RATING  FOR  THE  PERIOD  1976  TO  SEPTEMBER  1980 
($1,000) 


Mil  itary 

Civilian 

Labor 

Labor  Material  Contract 

Other 

Overhead 

Total 

4,010.6 


$  870.7 

$2,081.7 

151.2 

356.9 

1 ,156.1 

3,197.3 

408.9 

1,111.0 

609.5 

2,144.9 

209.9 

581 . 1 

355.2 

1,523.4 

7,175.0 

2,121.9 


TABLE  A-5 .  SUMMARY  PERFORMANCE  DATA  FOR  IPDCs  THROUGH  SEPTEMBER  1980 


TAEG  Report  No.  103 


Hot  complete 
Insufficient  data 


TAEG  Report  No.  103 


TABLE  A-2.  RELATIONSHIP  OF  COURSES  AND  CONTACT  HOURS  TO  THE  PERCENT 
OF  TOTAL  TRAINING  DAYS  FOR  TYPE  "A"  NAVEDTRACOM  COURSES 


Number  of 
Courses 

Training  Days 
(1,000) 

Percent  of  Total 
Training  Days 

Cumulative 
Contact  Hrs. 

Percent  of 
Total  Hrs. 

1 

470 

5 

139 

0.18 

4 

942 

10 

388 

0.50 

8 

1,885 

20 

1,307 

1.70 

10 

2,827 

30 

1,307 

1.70 

18 

3,770 

40 

2,833 

3.68 

29 

4,712 

50 

5,474 

7.10 

43 

5,655 

60 

9,509 

12.34 

54 

6,597 

70 

14,628 

18.98 

70 

7,540 

80 

21,092 

27.36 

104 

8,482 

90 

33,494 

43.45 

233 

9,425 

100 

77,087 

100.00 

TABLE  A-3.  RELATIONSHIP  OF  COURSES  AND  CONTACT  HOURS  TO  THE  PERCENT 
OF  TOTAL  TRAINING  DAYS  FOR  TYPE  "C"  NAVEDTRACOM  COURSES 


Number  of 
Courses 

Training  Days 
(1,000) 

Percent  of  Total 
Training  Days 

Cumulative 
Contact  Hrs. 

Percent  of 
Total  Hrs. 

4 

242 

5 

372 

0.09 

7 

485 

10 

668 

0.16 

20 

969 

20 

2,030 

0.50 

41 

1,454 

30 

7,646 

1.88 

78 

1,939 

40 

15,967 

3.93 

125 

2,424 

50 

27,950 

6.88 

220 

2,908 

60 

47,760 

11.76 

308 

3,393 

70 

73,990 

18.22 

458 

3,878 

80 

109,301 

26.92 

636 

4,362 

90 

161,731 

39.83 

1,510 

4,847 

100 

406,095 

100.00 
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TABLE  A-l .  SUMMARY  OF  OUTPUT  DATA  FOR  SELECTED  COURSES  AND/OR  COURSE  MODULES 
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*  Missing  Data 
**  Estimated 
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